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(54) Flicker correction apparatus, method and recording medium storing flicker correction 
program 



(57) A flicker correction apparatus for correcting a 
flicker component of an image signal obtained by imag- 
ing an object using an imaging device is provided. The 
apparatus comprises an image average calculation sec- 
tion for calculating an average of the image signal, a 
flicker frequency calculation section for calculating a 
flicker frequency, a flicker data extraction section for ex- 



tracting flicker data using the average of the image sig- 
nal and the flicker frequency, a flicker determination sec- 
tion for determining the presence or absence of a flicker 
phenomenon using the flicker data, a flicker correction 
amount calculation section for calculating a flicker cor- 
rection amount using the flicker data, and a flicker cor- 
rection section for removing the flicker component of the 
image data using the flicker correction amount. 
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Description 

1. FIELD OF THE INVENTION: 

s [0001] The present invention relates to a flicker correction apparatus, a flicker correction method, and a recording 
medium storing a flicker correction program for correcting a flicker component of an image signal obtained by imaging 
an object using an imaging device. More particularly, the present invention relates to a flicker correction apparatus, a 
flicker correction method, and a recording medium storing a flicker correction program capable of preventing the oc- 
currence of a flicker phenomenon. The flicker phenomenon is such that when an object is imaged using an X-Y address 

10 scanning type solid-state imaging device under the illumination of a fluorescent lamp flickering in synchronization with 
the frequency of an alternating current (AC) power source, a striped pattern of dark color portions and light color portions 
extending in the horizontal direction appear in the image. 



15 



50 

\ 



2. DESCRIPTION OF THE RELATED ART: 



[0002] Electronic cameras, such as video cameras, electronic still cameras, cameras for a videophone, and the like, 
comprise a CCD type imaging device as an image sensor The CCD type imaging device requires high power con- 
sumption and increases the number of parts . Therefore, it is not easy to construct a small-sized portable electronic 
camera system employing such a CCD type imaging device. On the other hand, attention has been directed to a CMOS 

20 type image sensor, which has low power consumption and in which an image sensor and a peripheral circuit can be 
mounted on one chip. Such a CMOS type image sensor is a solid-state imaging device in which pixels are provided 
in a matrix; incident light is converted into an electric signal by an imaging device; electric charge (an image signal) 
accumulates in a pixel; and the electric charge (the image signal) is read from the pixel by designating the X-Y address 
of the pixel. A solid-state imaging device, such as a CMOS type image sensor and the like, is called an X-Y address 

25 scanning type solid-state imaging device. 

[0003] When an object is imaged by an X-Y address scanning type solid-state imaging device, such as a CMOS 
type image sensor, under the illumination of a general fluorescent lamp which is lighted with an AC power source, since 
the fluorescent lamp blinks in synchronization with the frequency of the AC power source, the time point of scanning 
varies depending on the position of a pixel. As a result, bright portions and dark portions are generated in an image, 

30 degrading the quality of the image. Figure 7 is a schematic diagram showing an example of such image quality deg- 
radation. In Figure 7, a striped pattern, in which dark portions and bright portions extending in the horizontal direction 
are alternately formed, appears in one frame of the image of an apple, i.e., a flicker occurs. 

[0004] Figure 8 is a diagram for explaining a principle of the flicker phenomenon which occurs in an X-Y address 
scanning type solid-state imaging device. For example, it is now assumed that the frequency of an AC power source 
35 is 50 Hz, the blink frequency of a fluorescent lamp is 100 Hz, and the frame frequency of an imaging device is 30 Hz. 
In this case, a vertical scanning time is 33.3 msec during which all pixels are read out from top to bottom. During the 
vertical scanning time, the fluorescent lamp blinks in synchronization with the frequency of the AC power source. 
Therefore, in Figure 8, when a pixel on a (n-1) th line, a pixel on a n m line, and a pixel on a (n+1) th line are read out, the 
respective amounts of light (the fight amounts of a fluorescent lamp) impinging on the imaging device are different from 
40 each other. Therefore, a striped pattern in which bright portions and dark portions extending in the horizontal direction 
are alternately formed is observed in a frame of image, i.e. , the quality of an obtained image is degraded. When the 
vertical scanning time is an integral multiple of one blink cycle of the fluorescent lamp, such a horizontal dark-and- 
bright striped pattern (horizontal stripes) occurs at the same position on the screen. On the other hand, when the 
vertical scanning time is not an integral multiple of one blink cycle of the fluorescent lamp, the horizontal dark-and- 
45 bright striped pattern moves in the vertical direction on the screen, whereby the image quality is further degraded. 

[0005] A flicker correction apparatus for correcting a video signal so as to prevent the occurrence of a striped pattern 
due to such a flicker phenomenon has been disclosed in, for example, Japanese Laid-Open Publication No. 11-252446. 
This flicker correction apparatus is applied to a MOS type imaging device in which electric charge is read out from a 
pixel by designating the X-Y address of the pixel. The flicker correction apparatus divides a field of video signal into m 
so ( regions in each of which a flicker component is substantially uniform, and performs flicker correction for each region. 
\ For example, since a flicker component is considered to be substantially constant on one horizontal line, the intensity 
of a flicker component is obtained^on a line -by-line basis and flicker correction is performed for each line. 
[0006] Figure 9 is a schematic block diagra7^¥howlng a configurafidlfdTtheTiic^^ 

in Japanese Laid-OpenPublicationNo. 11-252446. This flicker correction apparatus has an input terminal 108 through 
55 which a video signal 1 20 containing a flicker is input. The video signal 120 input from the input terminal 1 08 is supplied 
to a total level calculation section 101 and a multiplication 106. The total level calculation section 101 integrates the 
video signal 120 for each region to produce a total level 121 which is in turn output to a switch 102. 
[0007] For example, it is now assumed that the field frequency of an image signal is 60 Hz and the frequency of an 
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AC power source is 50 Hz. In this case, a fluorescent lamp blinks at a frequency of 100 Hz. Since the field frequency 
60 Hz and the blink frequency 100 Hz of the fluorescent lamp have a greatest common divisor of 20 Hz, the same 
striped pattern occurs every 3 fields in which the stripe alternates between bright and dark. It is now assumed that 
when brightness Y 0 is uniform and a still object is imaged, an output Y ki (T) of an imaging device corresponding to an 
i th pixel in the horizontal direction on a k th line in the vertical direction of a T* h field varies in the form of a sine wave 
with a cycle of 3 fields and the phase of the sine wave is shifted in the direction of the line number k, and Y k j(T) of 
pixels on line k have substantially the same phase irrespective of position i. In this case, Y k j(T) is represented by: 



^ Y k j(T) = Y 0 {1 + Asin(2?iT/3 + ak)f ^ 



where A represents the amplitude of a flicker and-a rBp^esents^Jfiase coefficient relating to a vertical position. 
[0008] In this case, the total level calculation section 101 calculates a total level V k (T) by integrating Y k j(T) of all 
pixels on line k in accordance with the following formula. 



V * (T) 555 2^- l(T) = V ° a + Asin( 2717/3 + ak >> (Formula 1) 



[0009] In this manner, the total level 121 is changed by a factor of {1 -4-Asin(2rcT/3-Kxk)} due to an influence of a flicker. 
Therefore, if the total level 121 is multiplied by the inverse of the factor, the flicker component can be canceled. Note 

25 that in Formula 1 , V 0 represents the total of the direct current components (non-flicker components) of the output of 
an imaging device (the video signal 120), and n represents the number of effective pixels on a line. 
[0010] The flicker correction apparatus is provided with a region selection signal production section 107. This region 
selection signal production section 107 produces a region selection signal 122 indicating which of a region 1 to a region 
m the video signal 120 belongs to. The region selection signal 122 is supplied to a switch (SW) 102 and a switch (SW) 

30 105. The switch 102 switches a connection of the total level 121 in accordance with the region selection signal 122, 
and outputs the total level 121 to a total level storage section 103 in a region selected by the selection signal 122. 
[001 1 ] The total level storage section 1 03 comprises three shift registers and the like, and performs a shift operation 
in synchronization with a vertical synchronization signal such that a total level 123 of a first previous field, a total level 
124 of a second previous field, and a total level 125 of a third previous field are always held. Total levels V k (T-1), V k 

35 (T-2), and V k (T-3) of three previous fields from a field number T are stored, and each are output to a flicker gain 
calculation section 104. 

[0012] The flicker gain calculation section 104 comprises an averaging circuit and a division circuit, and calculates 
a flicker gain 126 from a plurality of total levels 123 to 125, which is in turn output to a flicker component extraction 
section 115. 

40 [0013] An average AVE k (T) of the total levels 123 to 125 of three fields is calculated based on the properties of 
trigonometric functions by the following formula. 



AVE k (T) = {V k (T -1) + V k (T - 2) + V k (T- 3)}/3 = V 0 (Formula 2) 

[0014] Therefore, AVE k (T) is constant irrespective of a field number T Therefore, the following formula is obtained 
from Formulas (1) and (2): 

50 {1 + Asin(2jcT/3 4- ak)} = V k (T)A/ 0 = V k (T)/AVE k (T) (Formula 3) 

[0015] In this case, the total level V k (T) has a cycle of 3 fields, and therefore, V k (T)=V k (T-3) is established. Therefore, 
the flicker gain calculation section 104 can calculate a flicker gain F k (T) from Formula 3 by: 

55 
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Fic(T) = l/{l+Asin(2JtT/3+ak)} 
= AVE k (T)/V k (T-3) . 

5 

[0016] The flicker gain F k (T) is a coefficient for canceling the flicker component of the output Y k j(T) of an imaging 
device, defined as the inverse of the flicker component, i.e., 1/{1+Asin(2nT/3+ak)}. 

[0017] The flicker component extraction section 1 15 comprises a Fourier transform circuit 117 and a high frequency 
10 component removing circuit 118. The flicker component extraction section 115 extracts a frequency component 140 
from the flicker gain 126 to produce a flicker extraction signal 141, which is in turn output to a flicker gain production 
section 116. 

[0018] Specifically, in the flicker component extraction section 115, the Fourier transform circuit 117 is first used to 
subject L flicker gains F k (T) (k=1 ,2, L) of m flicker gains of field number T to discrete Fourier transform so as to 
*5 calculate the frequency component 140 of the flicker gain 126. A component R f (T) corresponding to a frequency f is 
represented by: 



25 



R £ (T) - J) F k (T)e' 32 * m " 1 



( Formula 4 ) 



[0019] For example, a NTSC video signal has a horizontal scanning frequency of 15.75 kHz. When an AC power 
source has a frequency of 50 Hz and thus a fluorescent lamp has a blink frequency of 100 Hz, a flicker phenomenon 
occurs in which a stripe alternates between bright and dark every 157.5 lines. In this case, since the flicker gain F k (T) 
has a cycle of 157.5 lines, L is set to be 158 so that the flicker gains 126 corresponding to about one cycle can be 

30 subjected to a Fourier transform. Note that when L is an integral multiple of the cycle of a flicker gain, it is possible to 
improve the calculation precision of the frequency component 140 of the flicker gain, however, when L is not an integral 
multiple of the cycle of a flicker gain, it is possible to improve the precision by multiplying the flicker gain 126 by a 
window function before performing the Fourier transform. Although the flicker gains of line 1 to line L are subjected to 
a Fourier transform in the above-described technique, other lines can be used. 

35 [0020] In this way, among the frequency components 140 of the flicker gain, only the frequency component of the 
flicker component is left and the other frequency components are set to be zero by the high frequency component 
removing circuit 118, thereby producing the flicker extraction signal 141. For example, if flicker gains corresponding 
to one cycle are transformed into the frequency component 140, the flicker component 140 is dominated by R-|(T) 
indicating a fundamental wave. Therefore, if only a direct current component (f=0) and a fundamental wave (f=1) are 

40 left, a flicker extraction signal Q f (T) is represented by: 



Q f (T) - R f (T) (f - 0, 1) 1 

I — (Formula 5 ) . 
Q f (T) - 0 (f * 2 ( 



[0021] Note that if it is not easy to approximate a flicker component only by a fundamental wave, second-order and 
50 third-order harmonic components may be left. 

[0022] The flicker gain production section 116 comprises an inverse Fourier transform circuit 119, and produces a 
control gain 130 by performing a convolution of sine waves corresponding to the flicker extraction signal 141. The 
control gain 130 is output to the switch (SW) 106. A control gain G k (T) is represented by: 

55 
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L-l 

G K (T) - 1/ Qi(T)e : 

i = Q 

5 

( Formula 6 ) . 



10 [0023] The control gain 130 is calculated for each of k=1 , 2, — , m and is output to the switch (SW) 105. 

[0024] The switch (SW) 105 receives the input control gain 130 and outputs a control gain 131 of a region selected 
by the region selection signal 122 to the multiplication 106. The multiplication 106 multiplies the input video signal 120 
by the input control gain 131 and outputs it. 

[0025] Thus, by performing flicker correction for each region having substantially the same flicker component, a 
is flicker component can be removed in the case of a camera comprising an imaging device, such as a pickup tube, a 
MOS type imaging device, or the like, in which a flicker component varies in the vertical direction in the form of a sine 
wave in one field. 

[0026] However, in the above-described conventional flicker correction apparatus, a video signal is subjected to 
flicker correction even when an object is imaged under the illumination of sunlight which causes no flicker phenomenon. 

20 in this case, an image is adversely affected by flicker correction. Regions may have a different AC power source 
frequency and an imaging device may be used in such regions. For example, there are a region having an AC power 
source frequency of 50 Hz and another region having an AC power source frequency of 60 Hz, When the above- 
described imaging device is used in these regions having different AC power source frequencies, the constants for 
correction have to be adjusted for each region. Therefore, the user has to control the operation of a flicker correction 

25 apparatus depending on the illumination and the AC power source frequency. 

[0027] A frame frequency (or a field frequency) may vary depending on the system conditions of a camera. In some 
cases, data of a third or more previous frames may be required in order to calculate a flicker gain. For example, when 
a fluorescent lamp blinks at 100 Hz and the frame frequency of an imaging device is 14 Hz, the same bright-and-dark 
stripe pattern is generated every 7 frames . Therefore, data of 7 previous frames are required. Therefore, it takes a 

30 long time to correct a flicker depending on the frame or field frequency of an imaging device. 

SUMMARY OF THE INVENTION 

[0028] According to an aspect of the present invention, a flicker correction apparatus for correcting a flicker compo- 

35 nent of an image signal obtained by imaging an object using an imaging device is provided. The apparatus comprises: 
an image average calculation section for calculating an average of the image signal for each line or each group of lines 
in a horizontal or vertical direction; a flicker frequency calculation section for calculating a flicker frequency using an 
AC power source frequency and a frame or field frequency of the imaging device; a flicker data extraction section for 
extracting flicker data using the average of the image signal calculated by the image average calculation section and 

40 the flicker frequency calculated by the flicker frequency calculation section; a flicker determination section for deter- 
mining the presence or absence of a flicker phenomenon using the flicker data; a flicker correction amount calculation 
section for calculating a flicker correction amount using the flicker data; and a flicker correction section for removing 
the flicker component of the image data using the flicker correction amount calculated by the flicker correction amount 
calculation section and based on the determination by the flicker determination section. 

45 [0029] Therefore, the flicker determination section can determine the presence or absence of a flicker phenomenon, 
thereby making it possible not to perform flicker correction for an image obtained under the illumination which does 
not cause a flicker phenomenon, such as sunlight or the like. Moreover, flicker data is extracted using the average of 
image signals calculated for each line or each group of lines in the horizontal or vertical direction; and a flicker frequency 
calculated using an AC power source frequency and the frame or field frequency of an image device. A flicker correction 

50 amount is calculated from the flicker data. Therefore, data corresponding to frames or fields having the same bright 
or dark stripe is not required as is different from conventional flicker correction apparatuses. Therefore, flicker correction 
can be rapidly performed irrespective of the frame or field frequency of an imaging device, 

[0030] In one embodiment of this invention, the flicker correction apparatus further comprises an image memory for 
storing the image signal. The flicker correction section removes the flicker component of the image signal stored in the 
55 image memory using the flicker correction amount calculated by the flicker correction amount calculation section. 

[0031] In one embodiment of this invention, the flicker correction apparatus further comprises a flicker phase differ- 
ence calculation section for calculating a flicker phase difference, which is a phase difference between a flicker fre- 
quency of a past frame or field and a flicker frequency of a current frame or field, using the AC power source frequency 
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and the frame or field frequency of the imaging device. The flicker correction amount calculation section calculates a 
flicker correction amount using flicker data extracted from a past frame or field by the flicker data extraction section 
and the flicker phase difference calculated by the flicker phase difference calculation section, and the flicker correction 
section removes a flicker component of an image signal of a current frame or field using the flicker correction amount 

5 calculated by the flicker correction amount calculation section. 

[0032] Therefore, flicker data ts extracted from a past frame(s) or field(s) using the average of image signals calcu- 
lated for each line or each group of lines in the horizontal or vertical direction; and a flicker frequency calculated using 
an AC power source frequency and the frame or field frequency of an image device. A flicker correction amount is 
calculated from the flicker data and a flicker phase difference, which is a phase difference between the flicker frequency 

10 of the past frame or field and the flicker frequency of the current frame or field. Therefore, data corresponding to frames 
or fields having the same bright or dark stripe is not required as is different from conventional flicker correction appa- 
ratuses. Therefore, flicker correction can be rapidly performed irrespective of the frame or field frequency of an imaging 
device. 

[0033] In one embodiment of this invention, the flicker correction amount calculation section calculates the flicker 
is correction amount depending on a brightness of a pixel to be corrected in one frame or field of the image signal. 

[0034] Therefore, flicker correction can be performed depending on the brightness of a pixel. Therefore, even when 
a dark region is present in one frame or one field of image signals, flicker correction can be appropriately performed. 
[0035] In one embodiment of this invention, the flicker correction apparatus further comprises a flicker information 
storage section for storing information relating to the presence or absence of a flicker phenomenon output from the 
20 flicker determination section. The flicker determination section determines the presence or absence of a flicker phe- 
nomenon by referencing the information relating to the presence or absence of a past flicker phenomenon stored in 
the flicker information storage section. 

[0036] By referencing to flicker information of past frames or fields, flicker correction can be performed if a flicker 
phenomenon occurs during a period of several frames or fields, whereby error is reduced when determining whether 

25 or not correction of a flicker phenomenon is performed. 

[0037] In one embodiment of this invention, the flicker frequency calculation section calculates a first flicker frequency 
using a first AC power source frequency and the frame or field frequency of the imaging device, and calculates a second 
flicker frequency using a second AC power source frequency and the frame or field frequency of the imaging device. 
The flicker data extraction section comprises a first flicker data extraction sub-section for extracting first flicker data 

30 using the average of the image signal calculated by the image average calculation section and the first flicker frequency, 
and a second flicker data extraction sub-section for extracting second flicker data using the average of the image signal 
calculated by the image average calculation section and the second flicker frequency. The flicker determination section 
determines the presence or absence of a flicker phenomenon using the first and second flicker data. The flicker cor- 
rection amount calculation section calculates a flicker correction amount using the first or second flicker data based 

35 on the determination by the flicker determination section. 

[0038] Therefore, the flicker determination section can determine the presence or absence of a flicker phenomenon 
for each AC power source frequency. Even when an AC power source frequency is changed, a flicker can be appro- 
priately corrected. 

[0039] According to another aspect of the present invention, a flicker correction method for correcting a flicker com- 
40 ponent of an image signal obtained by imaging an object using an imaging device is provided. The method comprises 
the steps of: calculating an average of the image signal for each line or each group of lines in a horizontal or vertical 
direction; calculating a flicker frequency using an AC power source frequency and a frame or field frequency of the 
imaging device; extracting flicker data using the average of the image signal and the flicker frequency; determining the 
presence or absence of a flicker phenomenon using the flicker data; calculating a flicker correction amount using the 
45 flicker data; and removing the flicker component of the image signal using the flicker correction amount based on the 
determination of the presence or absence of a flicker phenomenon. 

[0040] According to this method, the presence or absence of a flicker phenomenon can be determined, thereby 
making it possible not to perform flicker correction for an image obtained under the illumination which does not cause 
a flicker phenomenon, such as sunlight or the like. 
so [0041] In one embodiment of this invention, the flicker correction method further comprises storing the image signal 
input from the imaging device. The removing step comprises removing the flicker component from the stored image 
signal using the flicker correction amount. 

[0042] Therefore, a reduction in image quality due to a flicker phenomenon can be prevented in an image obtained 
by an electronic still camera, a PC camera, or the like, comprising an X-Y address scanning type solid-state imaging 
55 device under the illumination of a fluorescent lamp blinking in synchronization with an AC powersource, thereby making 
it possible to display a high-quality image . 

[0043] In one embodiment of this invention, the flicker correction method further comprises : calculating a flicker 
phase difference, which is a phase difference between a flicker frequency of a past frame or field and a flicker frequency 
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of a current frame or field, using the AC power source frequency and a frame or field frequency of the imaging device. 
The flicker correction amount calculating step comprises calculating a flicker correction amount using flicker data of a 
past frame or field and the flicker phase difference. The flicker component removing step comprises removing a flicker 
component of an image signal of a current frame or field using the flicker correction amount. 
5 [0044] Therefore, a reduction in image quality due to a flicker phenomenon can be prevented in an image obtained 
by an electronic still camera, a PC camera, or the like, comprising an X-Y address scanning type solid-state imaging 
device under the illumination of a fluorescent lamp blinking in synchronization with an AC power source, thereby making 
it possible to display a high-quality image. 

[0045] In one embodiment of this invention, the flicker frequency calculating step comprises calculating a first flicker 
10 frequency using a first AC power source frequency and the frame or field frequency of the imaging device, and calcu- 
lating a second flicker frequency using a second AC power source frequency and the frame or field frequency of the 
imaging device. The flicker data extracting step comprises extracting first flicker data using the average of the image 
signal and the first flicker frequency, and extracting second flicker data using the average of the image signal and the 
second flicker frequency. The flicker phenomenon determining step comprises determining the presence or absence 
15 of a flicker phenomenon using the first and second flicker data. The flicker correction amount calculating step comprises 
calculating a flicker correction amount using the first or second flicker data based on the determination of the presence 
or absence of a flicker phenomenon. 

[0046] Therefore, the presence or absence of a flicker phenomenon for each AC power source frequency can be 
determined. Even when an AC power source frequency is changed, a flicker can be appropriately corrected. 
20 [0047] According to another aspect of the present invention, a recording medium storing a flicker correction program 
for controlling a procedure of the above-described flicker correction method is provided. 

[0048] Therefore, a reduction in image quality due to a flicker phenomenon can be prevented in an image obtained 
by an electronic stiil camera, a PC camera, or the like, comprising an X-Y address scanning type solid-state imaging 
device under the illumination of a fluorescent lamp blinking in synchronization with an AC power source, thereby making 

25 it possible to display a high-quality image, by software without particular hardware. 

[0049] Thus, the invention described herein makes possible the advantages of providing a flicker correction appa- 
ratus, a flicker correction method, and a recording medium storing a flicker correction program capable of performing 
rapid flicker correction irrespective of the frame or field frequency of an imaging device even when illumination and an 
AC power source frequency are changed. 

30 [0050] These and other advantages of the present invention will become apparent to those skilled in the art upon 
reading and understanding the following detailed description with reference to the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 [0051] 

Figure 1 is a schematic block diagram showing a configuration of a flicker correction apparatus according to Ex- 
ample 1 of the present invention. 

40 Figure 2 is a flowchart for explaining a procedure of a flicker correction method according to Example 1 of the 

present invention. 

Figure 3 is a diagram showing an exemplary system configuration capable of performing flicker correction using 
a flicker correction program according to Example 1 of the present invention. 

45 

Figure 4 is a schematic block diagram showing a configuration of a flicker correction apparatus according to Ex- 
ample 2 of the present invention. 

Figure 5 is a schematic block diagram showing a configuration of a flicker correction apparatus according to Ex- 
50 ample 3 of the present invention. 

Figure 6 is a schematic block diagram showing a configuration of a flicker correction apparatus according to Ex- 
ample 4 of the present invention. 

55 Figure 7 is a schematic diagram showing an image in which a flicker phenomenon occurs. 

Figure 8 is a diagram for explaining a principle of the occurrence of a flicker phenomenon. 
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Figure 9 is a schematic block diagram showing a configuration of a conventional Nicker correction apparatus, 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 [0052] Hereinafter, the present invention will be described by way of illustrative examples with reference to the ac- 
companying drawings. 

(Example 1) 

10 [0053] Figure 1 is a schematic block diagram showing a configuration of a flicker correction apparatus 30 according 
to Example 1 of the present invention. 

[0054] This flicker correction apparatus 30 has an input terminal 1 through which an image signal S1 is input. The 
image signal S1 is obtained by imaging an object using a camera comprising an imaging device, such as an electronic 
camera, a scanner, or the like. For example, when an object is imaged by a camera comprising an X-Y address scanning 
is type solid-state imaging device (e.g., a CMOS type image sensor, etc.) under the illumination of a fluorescent lamp 
which blinks in synchronization with the frequency of an AC power source, the image signal S1 containing a flicker 
component is input through the input terminal 1. 

[0055] The image signal S1 input through the input terminal 1 is supplied to an image memory 9, and one frame or 
one field of the image signal is stored as image data into the image memory 9. The image signal S1 is also supplied 

20 to an image average calculation section 2. 

[0056] The image average calculation section 2 calculates the average of image signals on each horizontal line 
based on the input image signal S1 , and outputs an image average S2 to flicker data extraction sections 3 and 4. The 
image average calculation section 2 can calculate the average of image signals for each group of lines or can calculate 
the average of image signals in the vertical direction. 

25 [0057] The flicker frequency calculation section 5 calculates a flicker frequency based on the frequency of an AC 
power source and the frame or field frequency of the imaging device. Specifically, the flicker frequency calculation 
section 5 calculates and outputs a flicker frequency S3 to a flicker data extraction section 3 assuming that the AC 
power source frequency is a first frequency, e.g., 50 Hz, and also calculates and outputs a flicker frequency S4 to a 
flicker data extraction section 4 assuming that the AC power source frequency is a second frequency, e.g., 60 Hz. 

30 [0058] The flicker data extraction section 3 subjects the image average S2 input from the image average calculation 
section 2 to discrete Fourier transform so as to calculate a spectral amount S5 of the flicker frequency S3 input from 
the flicker frequency calculation section 5 and spectral amounts S5' and S5 M of frequencies around the flicker frequency 

53. The spectral amounts S5, S5* and S5" are output to a flicker determination section 6. 

[0059] The flicker data extraction section 4 subjects the image average S2 input from the image average calculation 
35 section 2 to discrete Fourier transform so as to calculate a spectral amount S6 of the flicker frequency S4 input from 
the flicker frequency calculation section 5 and spectral amounts S6' and S6 U of frequencies around the flicker frequency 

54. The spectral amounts S6, S6' and S6° are output to a flicker determination section 6. 

[0060] The flicker determination section 6 determines the presence or absence of a flicker phenomenon based on 
the spectral amounts S5, S5' and S5" and also determines the presence or absence of a flicker phenomenon based 
40 on the spectral amounts S6, S6 1 and S6", and outputs a result of the determination as flicker information S8 to a flicker 
correction section 10. 

[0061 ] When the presence of a flicker phenomenon is detected, the flicker determination section 6 determines which 
AC power source frequency causes the flicker phenomenon, 50 Hz or 60 Hz. The result is output as flicker information 
S7 to a switch (SW) 7. The switch (SW) 7 is switched based on the flicker information S7 so that the spectral amounts 
45 S5, 55' and S5 M or the spectral amounts S6, S6' and S6" are output to a flicker correction amount calculation section 
8 depending on the AC power source frequency which is determined to cause the flicker phenomenon. When the 
absence of a flicker phenomenon is detected, flicker information S8 indicating the absence of a flicker phenomenon 
is input to the flicker correction section 10, so that no correction is performed. 

[0062] The flicker correction amount calculation section 8 subjects the spectral amount S5 or S6 input from the SW 
50 7 to inverse discrete Fourier transform so as to calculate a correction amount S9 which is in turn output to the flicker 
correction section 10. 

[0063] The flicker correction section 10 adds the flicker correction amount S9 input from the flicker correction amount 
calculation section 8 to image data containing a flicker component stored in the image memory 9 to cancel the flicker 
component, 

55 [0064] Hereinafter, a flicker correction method using the thus-obtained flicker correction apparatus 30 of Example 1 
will be described with reference to a flowchart shown in Figure 2. 

[0065] In Step 1 , the image signal S1 containing a flicker component is stored as image data into the image memory 9. 
[0066] In Step 2, in order to reduce an influence dependent on an object, the image average calculation section 2 
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calculates the average S2 of the image signal S1 for each line or each group of lines in the horizontal or. vertical 
direction. In Step 3, it is determined whether or not averaging of image signals is completed for all lines. 
[0067] For example, when averaging of image signals is performed in the horizontal direction for an output image 
having w horizontal pixels x h vertical pixels, the average of image signals on a y* h line is calculated by: 



s y - — Ys xy — (Formula 7) 



where S y represents the average of image signals on a y th line and S x y represents the value of an image signal at an 
X th pixel on a y* h line. 

[0068] Similarly, averaging can be performed for each group of lines but not for each line, or averaging can be 
15 performed in the vertical direction. 

[0069] When averaging of image signals is completed for all lines, the flicker frequency calculation section 5 calcu- 
lates the flicker frequencies S3 and S4 based on the frequencies of AC power sources and the frame or field frequency 
of an imaging device (Step 4). 

[0070] For example, a flicker frequency f can be calculated by: 



f=(2F/R)x(h/H) (Formula 8) 



where F represents the AC power source frequency of a fluorescent iamp, R represents the frame frequency of an 
25 imaging device, H represents the number of vertical pixels in one frame of the imaging device, and h represents the 
number of vertical pixels in an output image. 

[0071] Frequencies f-, and f h around the flicker frequency f can be assumed to be f-1 and f+1 , respectively. 
[0072] In Step 5, the flicker data extraction section 3 subjects the average S2 of the image signal S1 to Fourier 
transform to extract the spectral amount S5 of the flicker frequency S3 and the spectral amounts S5' and S5" of 
30 frequency components around the flicker frequency S3 as flicker data. Also in Step 5, the flicker data extraction section 
4 subjects the average S2 of the image signal S1 to Fourier transform to extract the spectral amount S6 of the flicker 
frequency S4 and the spectral amounts S6' and S6" of frequency components around the flicker frequency S4 as 
flicker data. 

[0073] For example, when the image signal average (a waveform in the vertical direction) S y obtained by averaging 
35 image signals in the horizontal direction, is subjected to discrete Fourier transform (DFT) so as to be transformed into 
spatial frequency, the real part S_Re[f], imaginary part S_lm[f ] and power spectrum S_Pw[f] of the spectral amount 
of the image signal average (a waveform in the vertical direction) S y with respect to an arbitrary frequency f are re- 
spectively calculated by: 

40. 

- 2/r 



S Re[f'] = V {S v cos( x f' x y)> • - • (Formula 9) 

{A y h 

S Im[f'] - Y {Ss±n( x f' x y) } • • • (Formula 10) 

y h 



Y-0 



S_Pw[f] - (S_Re[f']) 2 + (S_Im[f'] ) 2 • ■ - (Formula 11) 



[0074] When a flicker phenomenon occurs, the spectral amount of the flicker frequency f is greater than the spectral 
amounts of the respective frequencies fj and f h around the flicker frequency f. Therefore, the flicker determination 
55 section 6 can detect when a flicker phenomenon occurs, if the power spectra S_Pw[f], S.PwffJ and S_Pw[f h ] of the 
respective flicker frequency f, and the frequencies f 1 and f h around the flicker frequency f of the image signal average 
S y satisfy the following conditions: 
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S.Pwff^ x N < S_Pw[f] and S_Pw[f h ] x N < S_Pw[f] (Formula 12) 

where N represents an arbitrary constant indicating the steepness of a peak, 

5 [0075] It is assumed that a region has an AC power source frequency of 50 Hz while another region has an AC power 
source frequency of 60 Hz. In such a situation, the flicker determination section 6 determines the presence or absence 
of a flicker phenomenon based on the spectral amounts S5, S5' and S5" assuming that the AC power source frequency 
is 50 Hz and also determines the presence or absence of a flicker phenomenon based on the spectral amounts S6, 
S6' and S6" assuming that the AC power source frequency is 60 Hz, thereby making it possible to determine the AC 

10 power source frequency. 

[0076] In Step 6, the flicker correction amount calculation section 8 subjects the flicker data S5, S5' and S5 M , or S6, 
S6* and S6" of the flicker frequencies S3 or S4 to inverse Fourier transform so as to calculate the flicker correction 
amount S9. In Step 7, it is determined whether or not calculation of a flicker correction amount is performed for all lines. 
[0077] A waveform having an inverse phase to a flicker component is added to an image signal so as to perform 

15 correction. A flicker correction amount dS y for a y** 1 line is calculated by subjecting the S_Re[f] and S Jm[f] of a flicker 
frequency to inverse discrete Fourier transform (inverse OFT) in accordance with the following formula. 

dS y = -2 x 1 x {S_Re[f]cos(~5 x f x y) + sjm[f]sin(^ x f x y)} (Formula 13) 

[0078] When calculation of a flicker correction amount is completed for all lines, the flicker correction section 1 0 adds 
the calculated flicker correction amount S9 to image data stored in the image memory 9 so as to remove a flicker 
component in Step 8. In Step 9, it is determined whether or not all pixels are processed, and if yes, the flicker correction 
process is ended. 

[0079] Such a flicker correction process can be achieved by hardware, or alternatively, by a computer system using 
a recording medium storing a flicker correction program for controlling a procedure for flicker correction. 
[0080] Figure 3 is a diagram showing an exemplary system configuration capable of performing flicker correction 
using a recording medium storing the above-described flicker correction program. 

[0081] In this system, the above-described flicker correction program is stored in a recording medium, such as 
CD-ROM 20, a floppy disk (FD) 21, or the like. A computer 13 reads the flicker correction program recorded in the 
CD-ROM 20 via a CD-ROM drive 16, or reads the flicker correction program recorded in the FD 21 via a FD drive 17, 
and the installs the program into a hard disk 15. When the computer 13 receives an image signal containing a flicker 
component from a recording medium, such as the CD-ROM 20, the FD 21, or the like, or an external interface (IF) 22, 
the computer 1 3 writes the flicker correction program to an internal memory 1 4 and performs a flicker correction process 
as required. The computer 13 can be controlled by entering a command via a keyboard, amouse 19, or the like. The 
computer 13 can also display an image on a display apparatus 18 using an image signal which has been subjected to 
flicker correction. 

(Example 2) 

40 

[0082] Figure 4 is a schematic block diagram showing a configuration of a flicker correction apparatus 40 according 
to Example 2 of the present invention. 

[0083] This flicker correction apparatus 40 is not provided with an image memory 9 as in the flicker correction ap- 
paratus 30 of Example 1 (Figure 1). For example, a flicker correction amount is calculated based on a frame or field 

45 of the image signal previously input through an input terminal 1, such as a first previous frame or field, and such a 
flicker correction amount is used to correct a frame or field of the image signal currently input through the input terminal 
1 . In this case, there is a difference in the phase of a flicker component between the previous frame (or field) and the 
current frame (or field), and therefore, flicker correction has to be performed by taking the phase difference into con- 
sideration. In order to calculate the phase difference, the flicker correction apparatus 40 of Example 2 is provided with 

50 a phase difference calculation section 1 1 . 

[0084] An image signal S1 input through an input terminal 1 is supplied to an image average calculation section 2 
and a flicker correction section 10 as in the flicker correction apparatus 30 of Example 1 . 

[0085] The phase difference calculation section 1 1 calculates a phase difference S1 1 between the flicker frequency 
of the previous frame (or field) and the flicker frequency of the current frame (or field) based on the frequency of an 
55 AC power source and the frame or field frequency of an imaging device, and outputs the phase difference S11 to a 
flicker correction amount calculation section 8. 

[0086] For example, when the cycle of the flicker component T is H-R/2F, the phase difference Ay for one frame is 



30 
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calculated by: 



Ay = H - nT (Formula 14) 

5 

(note: n is the maximum natural number satisfying H>nT). 

[0087] The flicker correction amount calculation section 8 takes into consideration the phase difference S11 input 
from the phase difference calculation section 11 when subjecting the spectral amount S5 or S6 calculated based on 
image signal of the previous frame or field, input through the SW 7 as in Example 1 , to inverse discrete Fourier transform 
io so as to calculate a correction amount S9. The correction amount S9 is output to a flicker correction section 10. 

[0088] The flicker correction section 10 adds the flicker correction amount S9 calculated based on an image signal 
of the previous frame or field, input through the flicker correction amount calculation section 8, to an image signal of 
the current frame or field so as to cancel a flicker component. 
[0089] For example, an output S x y . of an x th pixel on a V th line is calculated by: 

15 

s xy = s x, y + dS y+ Ay' (Formula 15) 

[0090] The other portions of the configuration and the correction process of the flicker correction apparatus 40 of 
20 Example 2 are similar to those in Example 1 , and the description thereof is omitted. 

(Example 3) 

[0091] Figure 5 is a schematic block diagram showing a configuration of a flicker correction apparatus 50 according 
25 to Example 3 of the present invention. 

[0092] In this flicker correction apparatus 50, an image signal S1 input through an input terminal 1 is supplied to an 

image average calculation section 2 and a flicker correction section 10 as in the flicker correction apparatus 40 of 

Example 2(Figure 4). Further, the image signal S1 is supplied to a flicker correction amount calculation section 8. 

[0093] A horizontal, bright-and-dark striped pattern due to a flicker phenomenon is less conspicuous in a dark portion 
30 of an object than in a bright portion since a contrast is reduced in a dark portion. Therefore, when a bright pixel and a 

dark pixel are present on the same horizontal line in one frame or field of image, if the same flicker correction amount 

is added to the bright pixel and the dark pixel, an image may be degraded. 

[0094] In order to avoid such image degradation, in the flicker correction apparatus 50 of Example 3, a flicker cor- 
rection amount calculation section 8 calculates a flicker component or a correction amount S9 depending on the bright- 
35 ness of a pixel to be corrected in one frame or field of image signal, and outputs the correction amount S9 to a flicker 
correction section 10. 

[0095] For example, a correction amount for an x th pixel on a V th line is calculated by the following formula in accord- 
ance with a brightness threshold DY^ which can be arbitrarily selected. 



40 



45 



55 



dS y . = dS y x ^ ( Sjt . y < DS th ) 

dS . = dS ( S £ DS^ ) 

y y v x ,y tin * 



(Formula 16) 



[0096] The flicker correction section 10 adds the flicker correction amount S9 calculated based on an image signal 
of the previous frame or field, input from the flicker correction amount calculation section 8, to an image signal of the 
50 current frame or field so as to cancel a flicker component. 

[0097] For example, an corrected output S x y . for an X th pixel on a y th line is calculated by: 



s x.y = s x, y + dS y (Formula 1 7) 



[0098] The other portions of the configuration and the correction process of the flicker correction apparatus 50 of 
Example 3 are similar to those in Example 2, and the description thereof is omitted. 
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(Example 4) 

[0099] Figure 6 is schematic block diagram showing a configuration of a flicker correction apparatus 60 according 
to Example 4 of the present invention. 
5 [0100] This flicker correction apparatus has a flicker information storage section 12 in addition to the flicker correction 
apparatus 50 of Example 3 (Figure 5). 

[0101] A single frame or field of image signal is used to determine the presence or absence of a flicker phenomenon 
and perform flicker correction, however, in this case, a detection error may occur. 

[0102] A flicker phenomenon is present over a plurality of frames or fields . Therefore, in the flicker correction appa- 
10 ratus 60 of Example 4, the flicker information storage section 12 accumulates the results of determination of the pres- 
ence or absence of a flicker phenomenon over a plurality of frames or fields. The flicker determination section 6 refer- 
ences past flicker information stored in the flicker information storage section 12. If a flicker phenomenon is present 
during a period of several frames or fields, flicker information S7 and S8 are generated and output to a SW 7 and a 
flicker correction section 10 so that flicker correction is performed. 
'5 [0103] The other portions of the configuration and the correction process of the flicker correction apparatus 60 of 
Example 4 are similar to those in Example 3 ( and the description thereof is omitted. 

[0104] As described above in detail, according to the present invention, a flicker determination section can determine 
the presence or absence of a flicker phenomenon. Therefore, even when illumination and an AC power source fre- 
quency are changed, a flicker can be appropriately corrected. Data corresponding to frames or fields having the same 

20 bright or dark stripe is not required as is different from conventional flicker correction apparatuses. Therefore, flicker 
correction can be rapidly performed irrespective of the frame or field frequency of an imaging device. 
[0105] A flicker correction amount calculation section can calculate a flicker correction amount depending on the 
brightness of a pixel, and the flicker correction amount is used in flicker correction. Therefore, even if a dark region is 
present in one frame or field of image signal, flicker correction can be appropriately performed. 

25 [0106] A flicker information storage section accumulates information on the presence or absence of a flicker in past 
frames or fields. A flicker determination section references such information. Therefore, flicker correction can be per- 
formed if a flicker phenomenon occurs during a period of several frames or fields, whereby error is reduced when 
determining whether or not correction of a flicker phenomenon is performed. 

[01 07] According to the present invention, a reduction in image quality due to a flicker phenomenon can be prevented 
30 jn an image obtained by an electronic still camera, a PC camera, or the like, comprising an X-Y address scanning type 
solid-state imaging device under the illumination of a fluorescent lamp blinking in synchronization with an AC power 
source, thereby making it possible to display a high-quality image. 

[0108] Various other modifications will be apparent to and can be readily made by those skilled in the art without 
departing from the scope and spirit of this invention. Accordingly, it is not intended that the scope of the claims appended 
35 hereto be limited to the description as set forth herein, but rather that the claims be broadly construed. 



Claims 

40 1 . A flicker correction apparatus for correcting a flicker component of an image signal obtained by imaging an object 
using an imaging device, the apparatus comprising: 

an image average calculation section for calculating an average of the image signal for each line or each group 
of lines in a horizontal or vertical direction; 
45 a flicker frequency calculation section for calculating a flicker frequency using an AC power source frequency 

and a frame or field frequency of the imaging device; 

a flicker data extraction section for extracting flicker data using the average of the image signal calculated by 
the image average calculation section and the flicker frequency calculated by the flicker frequency calculation 
section; 

50 a flicker determination section for determining the presence or absence of a flicker phenomenon using the 

flicker data; 

a flicker correction amount calculation section for calculating a flicker correction amount using the flicker data; 
and 

a flicker correction section for removing the flicker component of the image signal using the flicker correction 
55 amount calculated by the flicker correction amount calculation section and based on the determination by the 

flicker determination section. 

2. A flicker correction apparatus according to claim 1 , further comprising: 
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an image memory for storing the image signal, 

wherein the flicker correction section removes the flicker component of the image signal stored in the image 
memory using the flicker correction amount calculated by the flicker correction amount calculation section. 

A flicker correction apparatus according to claim 1 , further comprising: 

a flicker phase difference calculation section for calculating a flicker phase difference, which is a phase differ- 
ence between a flicker frequency of a past frame or field and a flicker frequency of a current frame or field, 
using the AC power source frequency and the frame or field frequency of the imaging device, 

wherein the flicker correction amount calculation section calculates a flicker correction amount using flicker 
data extracted from a past frame or field by the flicker data extraction section and the flicker phase difference 
calculated by the flicker phase difference calculation section, and 

the flicker correction section removes a flicker component of an image signal of a current frame or field using 
the flicker correction amount calculated by the flicker correction amount calculation section. 

A flicker correction apparatus according to claim 1 , 

wherein the flicker correction amount calculation section calculates the flicker correction amount depending on a 
brightness of a pixel to be corrected in one frame or field of the image signal. 

A flicker correction apparatus according to claim 1 , further comprising: 

a flicker information storage section for storing information relating to the presence or absence of a flicker 
phenomenon output from the flicker determination section, 

wherein the flicker determination section determines the presence or absence of a flicker phenomenon by 
referencing the information relating to the presence or absence of apast flicker phenomenon stored in the flicker 
information storage section. 

A flicker correction apparatus according to claim 1 , 
wherein: 

the flicker frequency calculation section calculates a first flicker frequency using a first AC power source fre- 
quency and the frame or field frequency of the imaging device, and calculates a second flicker frequency using 
a second AC power source frequency and the frame or field frequency of the imaging device; 
the flicker data extraction section comprises a first flicker data extraction sub-section for extracting first flicker 
data using the average of the image signal calculated by the image average calculation section and the first 
flicker frequency and a second flicker data extraction sub-section for extracting second flicker data using the 
average of the image signal calculated by the image average calculation section and the second flicker fre- 
quency; 

the flicker determination section determines the presence or absence of a flicker phenomenon using the first 
and second flicker data; and 

the flicker correction amount calculation section calculates a flicker correction amount using the first or second 
flicker data based on the determination by the flicker determination section. 

A flicker correction method for correcting a flicker component of an image signal obtained by imaging an object 
using an imaging device, the method comprising the steps of: 

calculating an average of the image signal for each line or each group of lines in a horizontal or vertical direction; 
calculating a flicker frequency using an AC power source frequency and a frame or field frequency of the 
imaging device; 

extracting flicker data using the average of the image signal and the flicker frequency; 
determining the presence or absence of a flicker phenomenon using the flicker data; 
calculating a flicker correction amount using the flicker data; and 

removing the flicker component of the image signal using the flicker correction amount based on the determi- 
nation of the presence or absence of a flicker phenomenon. 
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8. A flicker correction method according to claim 7, 
further comprising: 

storing the image signal input from the imaging device, 

5 

wherein the removing step comprises removing the flicker component of the stored image signal using the 
flicker correction amount. 

9. A flicker correction method according to claim 7, 
10 further comprising: 

calculating a flicker phase difference, which is a phase difference between a flicker frequency of a past frame 
or field and a flicker frequency of a current frame or field, using the AC power source frequency and a frame 
or field frequency of the imaging device, 

15 

wherein the flicker correction amount calculating step comprises calculating a flicker correction amount using 
flicker data of a past frame or field and the flicker phase difference, and 

the flicker component removing step comprises removing a flicker component of an image signal of a current 
frame or field using the flicker correction amount. 

20 

10. A flicker correction method according to claim 7, 
wherein: 

the flicker frequency calculating step comprises calculating a first flicker frequency using a first AC power 
25 source frequency and the frame or field frequency of the imaging device, and calculating a second flicker 

frequency using a second AC power source frequency and the frame or field frequency of the imaging device; 
the flicker data extracting step comprises extracting first flicker data using the average of the image signal and 
the first flicker frequency, and extracting second flicker data using the average of the image signal and the 
second flicker frequency; 

30 the flicker phenomenon determining step comprises determining the presence or absence of a flicker phe- 

nomenon using the first and second flicker data; and 

the flicker correction amount calculating step comprises calculating a flicker correction amount using the first 
or second flicker data based on the determination of the presence or absence of a flicker phenomenon. 

35 1 1 . A recording medium storing a flicker correction program for controlling a procedure of a flicker correction method 
according to claim 7. 

1 2. A flicker correction apparatus for correcting a flicker component of an image signal obtained by imaging an object, 
the apparatus comprising 

40 means for processing the image signal to extract flicker data and produce there from a flicker correction to 

be applied to the image signal; 

means for determining from the flicker data the presence or absence of flicker in the image signal; and 
means for applying or not applying the flicker correction to the image signal, depending on the determination 

by the determining means. 

45 

13. A flicker correction program comprising computer-readable means adapted to perform the steps of the flicker 
correction method of any of claims 7 to 10 when run on a computer apparatus. 
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FIG. 3 
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